Skip to content

Conversation

@dmiales
Copy link

@dmiales dmiales commented Jan 2, 2026

perf: implement streaming XML parsing for large folder operations

  • Add StreamingReadFolderRemoteOperation for memory-efficient folder reading using SAX parser
  • Add PropFindSaxHandler for streaming XML parsing of PROPFIND responses
  • Prevent OutOfMemoryError for folders with thousands of files by avoiding full XML loading
  • Integrate streaming parser into RefreshFolderOperation with fallback to legacy method
  • Add batch processing for large folders (500 files per batch) in FileDataStorageManager
  • Improve logging levels and add thread name tracking for better debugging

… operations

- Add PropFindSaxHandler for parsing PROPFIND responses
- Add StreamingReadFolderRemoteOperation for efficient folder reading
- Improve file collision detection in UploadFileOperation:
  * For non-encrypted files, compare content instead of just names
  * Skip upload only when files are actually identical
  * Return conflict when same-named files have different content
  * Preserve original behavior for encrypted files
- Add StreamingReadFolderRemoteOperation for memory-efficient folder reading using SAX parser
- Add PropFindSaxHandler for streaming XML parsing of PROPFIND responses
- Prevent OutOfMemoryError for folders with thousands of files by avoiding full XML loading
- Integrate streaming parser into RefreshFolderOperation with fallback to legacy method
- Add batch processing for large folders (500 files per batch) in FileDataStorageManager
- Improve logging levels and add thread name tracking for better debugging
@dmiales dmiales closed this Jan 2, 2026
@dmiales dmiales deleted the feature/additional-improvements branch January 2, 2026 03:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant